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ABSTRACT 

The Career Education Cognitive Questionnaires were 
originally developed in 1973. The tests are designed to measure 
cognitive knowledge about the world of work for children in grades 
one through nine. Revisions were made in each of the three tests 
based upon item analysis and teacher reviews. Following revisions ^ 
test-retest reliabilities were obtained by grade level for each of 
the three tests* The validation portion of the study was designed to 
identify face and content validity as well as estimates of vocational 
maturity and differences between groups or levels of sex, teacher 
emphasis, levels of father's education, and father's occupation. 
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DEVELOPMENT OF THE CAREER EDUCATION COGNITIVE QUESTIONNAIRE 

FOR GRADES ONE THROUGH NINE 



During the school year 1972-73. members of the staff of the Minnesota 
Research Coordinating Unit for Vocational Education at the University of 
Minnesota developed a set of career education evaluation instruments. These 
instruments were designed for use in Minnesota's eight funded career educa- 
tion sites to obtain a summative evaluation of the impact of career educa- 
tion on students enrolled in programs at the eight sites. 

Instrument Development 

Career Education Cognitive Questionnaires for grades 1-3, 4-6, and 7-9 
were based upon the ''Rationale for Education for Work" (Moss, Smith, and 
Copa, 1972). The "Rationale for Education for Work" states that society 
is composed of an aggregate of individuals who share a way of life. It is 
the ultimate goal of society to maximize the self-actualization of each 
individual and to improve the quality of this shared way of life. Given 
this purpose of society, education is perceived as a sequence of planned 
learning experiences designed to facilitate self-actualization and inter- 
action through the roles people are expected to play. The role activities 
which help bring about self-actualization and an increase in the quality of 
the shared way of life can be classified as either income-producing or income 
consuming. The income-producing activities can be further classified as 
income earning (wages, salaries, and earnings) or income savings. From an 
economic point of view, work is the activity entered into by the individual 
for the purpose of income earning or income savings, either for the indi- 
vidual or for his designate(s) . A "career" is made up of person's work 
activities throughout his/her work history (Moss, Smith, and Copa, 1972). 

The CECQ were developed to measure how much children know about con- 
cepts relating to theworldof work. During the initial test development, 
nine content areas were identified which were believed to span important 
knowledges. These content areas are shown in Figure 1 with intermediate 
knowledges listed below each of the nine content areas. The intermediate 
knowledges were used to identify specific content for questions on each of 
the three tests. 



Revised Forms of CECQ 

The three Career Education Cognitive Questionnaires developed during 
1973 were revised In 1975. This revision was necessary in order to update 
many questions due to our changing society. Another reason for revisions 
involved increasing the psychometric properties of the test. The revised 
forms of the CLoQ are now available with the older versions eliminated from 
further use. 
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Description of Original Instruments Before Revisions 

A separate evaluation instrument was designed for the occupational 
awareness stage (grades K-3) , the occupational orientation stage (grades 
4-6), and the occupational exploration stage (grades 7-9). 

The CECQ 1-3 was designed for career development Stage I and consisted 
of the following content areas (shown in Figure i): (a) industry, (b) occu- 
pational levels, (c) ability requirements, (d) needs (and/or job satisfac- 
tion), and (e) working condition (or characteristics); although the career 
development Stage I is appropriate for grades K-3, the CECQ 1-3 was designed 
for only grades 1-3, 

The test items utilized photographs of workers and working conditions. 
The test was designed to be read to the children followed by having them 
place an "X" under the photograph best answering the question, A total of 
29 items were selected from forms A and B based upon the item analysis con- 
ducted after the pilot test. 

The CECQ 4-6 included 52 matching and multiple choice items. The con- 
tent areas represented in this instrument included all those used for the 
CECQ 1-3 plus career decision-process (see Figure 1), After consulting 
with a reading specialist, the tests were designed so that students could 
read and answer each question at individual paces. 

The CECQ 7-9 consisted of 56 multiple choice questions. In addition 
to items selected for all previously mentioned content areas, the CECQ 7-9 
included items having the content area of Employment Trends, This evalua- 
tion instrument was designed so that students could read and respond to ques- 
tions at their own pace. 

During 1974-75, each of the three CECO instruments were revised using 
complete item analysis and inservice teacher recommendations. 
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TECHNICAL REPORT OF CAREER EDUCATION COGNITIVE QUESTIONNAIRES 



In order to obtain measures of reliability for each of the three tests, 
a sample of students at grades one through nine were administrered one of the 
Career Education Cognitive Questionnaires. Two weeks lalier, they were again 
administered the same test. A correlation between the initial test scores 
with the retest scores provide a measure of the testes stability over time. 

Validation of the three Career Education Cognitive Questionnaires take 
the form of face and content validity as well as correlating the instruments 
with the variables of grade level, amount of teacher emphasis given to career 
education, sex, father*s occupational level, and father's educational level. 
The variable of grade level was selected based upon the belief that scores 
should increase with maturity. Amount of teacher emphasis given to career " 
education should be directly proportional to student test scores (presuming 
other variables are controlled). Sex should theoretically, have no effect 
upon test scores, Father*s occupational and educational levels were variables 
selected as measures of socio-economic status (Forrest, 1971; Super, 1971; 
Hamburger, 1958). The higher the socio-economic status the higher student 
test scores are likely to be because of the opportunities provided for learn- 
ing at home. 

The Career Education Cognitive Questionnaire was administered to 976 
students at two career education sites in Minnesota. Four classes of students 
at each of the nine grade levels were utilized. These students were admin- 
istered the appropriate test for their grade levels, and two weeks later they 
were again administered the original test. 

Information was obtained from the teachers regarding the amount of time 
spent on the subject matter which the tests were designed to measure between 
the two testings. An analysis of this information showed that most teachers 
devoted less than 30 minutes during the two weeks to career education cognitive 
information. However, there were two teachers who devoted over two hours to 
career education concepts during the two-week interval. Since these two 
teachers were in a minority, it was assumed that classroom instructions had 
little influence upon student scores on the retest. 



Reliability 

The test-retest reliability obtained consists of a person-product moment 
correlation. During the analysis of the results those students who were absent 
from either the initial testing session or the retest were eliminated. 



Face Validity 

A sample of fifteen (15) in-service teachers, with five (5) teachers 
assigned to each evaluation instrument, were asked to respond to the following 
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questions: 1, Does each test question depict a career educa:ion concept? 
2. Does the concept depicted by each question represent an "important" career 
education concept? 3. How much emphasis, in their behalf. 5 hould be placed 
on the concept depicted by each question? 



Content Validity 

The fifteen (15) teachers who reviewed the three cognitive career educa- 
tion instruments also reviewed and judged the content of ef ch test question. 

Five teachers at each of the three test levels were a; ked to classify 
each item into the content areas for which the tests were (esigned. It was 
theorized that if each item can be classified into one of :he content areas 
for which the tests were designed, and the classification.^ made by the teachen 
were similar to those made by the test developers, the te. .t could be judged 
to have content validity. 

The content areas of Figure 1 were renamed and gtoup td to obtain a more 
independent content classification scheme. This regrouplig was necessary so 
that teachers could better understand the content areas (also referred to as 
concept areas) for which the tests were designed. The reclassified content 
areas are labelled as follows: 

1. Tools and equipment of occupations 

2. Educational training requirements of occupations 

3. Activities and duties required 

4. Working conditions of occupations 

5. Social status (income) of occupations 

6. Industrial trends 

7. Identification of jobs and job clusters 

8. Information sources 

9. Workers satisfaction 
10. Career planning 

It should be noted that the regrouped co'itent areas are not totally 
independent of one another, and, therefore, in some cases an item could 
logically be classified in several content areas. 

Test devczlopers classified each item of each of the three tests into 
the content areas for which the tests were developed. This mapping of content 
areas for which the tests were developed can then be compared with teacher 
classifications, thus allowing for judgement of the content validity of each 
of the three tests. Teachers were asked to classify each item into the content 
areas which best identify the content of the item; in several instances one 
teacher believed that some questions could be classified equally well into 
two or more content areas. 



Construct Validi ty 

The sample used for the validation of the Career Education Cognitive 
Questionnaires consists of the students that were used for the test-retest 
reliability calculations. 
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The statistics employed to analyze the student biographical data with 
respect to mean scores included the t-test, one-way analysis of variance, 
and the non-parametric correlation, Kendall's Tau. In instances where the 
one-way analysis was employed, a Modified Least Squares Difference statistic 
was used to test for significant differences between all possible pairs of 
means. Kendall's Tau was used to determine the relationship between a 
student's rank on one variable with his score on the test (ranked). 
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CAREER EDUCATION COGNITIVE QUESTIONNAIRE 
FOR GRADES 1 THROUGH 3 

Reliability 

The reliability coefficients for the CECQ 1-3 ranged from ,943 to .969 
(see Table 1), These relationships indicate that students obtained approxi- 
mately the same relative socre on the second administration of the test 
as on the first, 

TABLE 1 

TEST-RETEST REQLIABILITIES FOR CECQ 1-3 

Test ReTest Test-Ret est" 



Grade 


N 


Mean 


S.D. 


Mean 


S.D. 


Coefficient 


1 


80 


25.44 


5.71 


25.77 


5.62 


.943 


2 


77 


20.08 


5.57 


28.31 


5.43 


.953 


3 


89 


29.52 


5.86 


29.43 


5.74 


.969 



Face Validity 

The five teachers reviewing the instrument for grades one through 
three were generally in agreement that all items on the revised form de- 
picted career education concepts. Two items pertaining to the income of 
specific occupations as compared with other occupations of either higher 
or lower income were singled out for further discussion. Two teachers who 
id entif ied these items as possible non— career education concepts were 
given further explanation and clarification by others in the group. Fol- 
lowing these discussions, all of the teachers agreed that all items depicted 
career education concepts. 

The importance of each career education concept depicted by the items 
was assessed by combining teacher responses to the importance of the concept 
and the emphasis they believed should be placed on the concept. Several 
items were classified as not important to the teachers. They believed the 
concepts in these items should be taught only to older children; i.e,, 
fifth or sixth graders. Items selected as not important for first through 
third graders were those dealing with such words as florist, communication, 
and apprenticeship. Teachers felt the meanings of such words were not com- 
monly understood by younger students. However, data obtained during pre- 
pilot and pilot testing of the revised instrument did not substantiate their 
concerns, with the majority of students correctly answering questions con- 
taining the identified words. • 
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Content Validity 

The evaluation instrument for grades one through th^"®^ ^^^^^alns ^0 
questions, all of which were classified within the presc^'^'^^^ ^'^nte^^ areas 
(see Figure 2). The shaded areas represents classif icati°^^ ?^ the ^^st 
developers and the numbers represent frequency of classifica^ '^^ inser- 
vice teachers. There seems to be general agreement among ^h^^^^j^gwing 
teachers about which content area best described the content ^^t^tcte^ W 
each of the items. This is evident in that for most itetn^> ^ ot more 
teachers selected the same content area. The CECQ 1-3 c^ti b^^h^^ght to 
have content validity, since all the teachers identif ied ^^^^ ^ , ^He P^^"* 
identified content areas as best describing the content e^^^ question 
and teachers classified questions similarly to the test d^^^J-^^^^g^ 



Grade Levels 



Achievement tests should have the ability to identify ^^^U^^tion* 
In the case of the Career Education Cognitive Questionnaii^^j abi^^^^y 
to measure vocational maturity is important. Table 2 s\iO^^ differences 
in student mean scores by grade level within each of the ^^^^^^^sts* 
Student mean scores for the CECQ 1-3 increased from 25.4 first 
grade to 29.5 for the third grade (see Table 2). The diff^r^^^^^ among 
grade levels are statistically significant at the .01 leV^^* increase 
in mean scores with an increase in grade level is also sli^^ the signi- 
ficant correlation (.01 level) between grade level and me^n ^^^^^ (gee 
Table 3). A conservative post hoc test (modified least ^quaJ^^^ difference) 
of significant difference between all possible pairs of ni^^n ^^'^>^es (grades 
1 and 2, 2 and 3, and 1 and 3) did not reveal where the d^-^^^^^Ves were. 



TABLE 2 



DIFFERENCES AMONG MEAN SCORES BY GRADE LEVEL fO^ CS^^ 



Grade First Second Third F-Ratio Signi^ i^^^^^^ 



Mean 25.4 28.0 29.5 11.4 



**Signif icant at .01 
* Significant at .05 



TABLE 3 

RELATIONSHIP OF STUDENT SCORES TO GRADE LEVEL C^^^ ^^3 
Co rr elat ion S ignif icance 



,282 



.001** 



11 



**Signif icant at .01 
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FIGURE 2 fcontinued) 
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Teacher Emphasis 

During the initial test session, teachers were aske. low much time 
(hours per week) during the past year they had devoted to teaching the career 
education concepts, »7hich the Career Education Cognitive Questionnaire was 
designed to measure. The amount of time teachers emphasized the concepts 
was classified into groups of low emphasis and high emphasis. Since there 
were only four teachers at each grade level, a difference between low and 
high emphasis In some cases could not be obtained. Grade levels were collapsed 
to obtain one group of low and one group of high emphasis per test. The dis- 
tributions of both high and low emphasis groups were carefully reviewed to 
insure that each group contained similar numbers of students from each of the 
three grade levels involved in the groupings. The amount of teacher's emphasis 
on Career Education for the CECQ 1-3 was: 

low emphasis 0,5 - 2,5 hours per week (N = 72) 
high emphasis 4,5 - 7,0 hours per week (N = 91) 

A comparison of low and high emphasis groups in terms of mean test scores 
showed that students in grades one through three low emphasis group obtained 
a mean of 28, 7 ♦ with students in the high emphasis group having a mean of 28,5 
(see Table 4), This difference was not significant. 



TABLE 4 

TEST FOR DIFFERENCES AMONG MEANS BY LOW TEACHER EMPHASIS 
VS, HIGH TEACHER EMPHASIS FOR THE CECQ 1-3 



Emphasis 

Low High t"Value Signif icance 
28,7 28,5 ,21 ,831 



**Signif icant at ,01 
* Significant at ,05 



Sex 

Another important aspect of an achievement test is its fairness to 
both males and females. Students were grouped according to their sex, and 
mean scores calculated and tested for differences. 

The difference between mean scores for males and females for the CECQ 
1-3 showed the only significant difference (at the ,01 level) at the third 
grade (see Table 5), At grade three, males had an advantage of 1,6 points 
over females. At grades one and two, however, there were not significant 
differences between the sexes. 
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TABLE 5 



TEST FOR DIFFERENCE AMONG MEANS 
AS AFFECTED BY SEX FOR THE CECQ 1-3 



Grade 



Males 



Females 



t-Value 



Significance 



1 
2 
3 



25,9 
28,8 
31.1 



26.1 
27.6 
28.5 



-.23 
1.18 
2.89 



.817 
.243 
.006** 



**Signif icant at .01 
* Significant at .05 



Father's Occupation 

Students were asked to identify the occupations of their fathers. In 
cases where the fathers did not live at home, the students were asked to 
identify the occupation of the head of the household. The occupation was 
then classified according to the following categories: 



1 unskilled 

2 =» semi-skilled 

3 » skilled 

4 - semi-professional & small business management 

5 =* professional and managerial II 

6 professional and managerial I 



Mean scores were then calculated for each occupational level of the father 
for each grade level and a one-way ANOVA used to compare the means. 

Mean scores for father's occupation at grades one through three ranged 
from a low of 25.0 to a high of 32.7 (see Table 6). For grades one, two, 
and three, there were no significant differences among mean scores grouped 
according to the level of father's occupation. The correlation between 
mean score and level of father's occupation at grade one revealed a slight 
negative relationship. At grades two and three, there were positive rela- 
tionships; however, none of these coefficients were statistically significant 
•(see Table 7). Since there were no significant differences between means 
using a one-way ANOVA, a test for significance of all possible pairs was 
not calculated. 
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TABLE 6 

DIFFERENCES IN MEAN SCORES AS RELATED TO 
FATHER'S OCCUPATIONAL LEVEL FOR THE CECQ 1-3 



Father's Occupational Level 
L_. 2 3 4 5 6 F-Ratio Significance 

1 28.0 26.7 25.1 26.0 .184 .906 

2 25.0 29.7 30.0 27.3 31.3 .964 .442 

3 29.8 28.0 29.9 32.7 .788 .510 



**Signif icant at .01 
* Significant at .05 



TABLE 7 



RELATIONSHIP OF MEAN SCORE TO FATHER'S 
OCCUPATIONAL LEVEL FOR THE CECQ 1-3 



Grade Corre l a t ( s ign if ic anc e 

1 -.078 .273 

2 .127 .147 

3 .156 .098 



**Signif icant at .01 
* Significant at .05 



Father's Education 

Students were asked to identify their father's highest level of educa- 
tion. In cases where students did not live with their fathers, the educa- 
tion of the head of the household was obtained. Father's education was thei 
classified into the following categories: 

1=1 through 5 years 

2=6 through 8 years 

3=9 through 11 years 

4 = high school graduate (12 years) 

5=1 through 3 years of college 

6 = college graduate 

7 = college graduate plus additional graduate studies 

The mean scores of students were calculated within each level of father's 
education for each grade. 

The analysis of mean scores among level of father's education for the 
CECQ 1-3 showed no significant difference at any grade level (see Table 8). 
There was no significant correlation between mean scores and level of 
father's education at grades one, two, or three (see Table 9). 
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TABLE 8 



DIFFERENCES IN MEAN SCORES AS AFFECTED BY FATHER'S EDUCATIONAL 

LEVEL FOR THE CECQ 1-3 





Grade 1 


2 


3 


4 


5 6 


7 


F- Ratio 


Significance 


1 


28.0 


26.7 


25.1 


26.0 


30.0 


.328 


.857 


2 


25.0 


29.7 


30.0 


27.3 31.3 


30.0 


.783 - 


.570 


3 


29.8 


28.0 


29.0 


32.7 


31.7 


.721 


.584 



**Signif leant at .01 
* Significant at .05 



TABLE 9 

RELATIONSHIP OF STUDENT SCORES TO FATHER'S EDUCATIONAL 
LEVEL FOR THE CECQ 1-3 



Grade Correlation Significance 



1 0 .500 

2 .109 .175 

3 -181 .058 



**Signif icant at .01 
* Significant at .05 



17 



16 



CAREER EDUCATION COGNITIVE QUESTIONNAIRE 
FOR fiRADFS 4 THROUGH 6 



Reliabilities 

The test-retest reliabilities for the CKCQ 4-6 ranged from ,895 to 
•906 (see Table 10) • This range of reliabilities indicates that this test 
is stable over the two week period. 

TABU- 10 

TEST-RETKST REL lAB 1 1. LTIKS FOR CECQ 4-6 



Test Ret est Test-Retest 

Grade N Mean S,D, Mean S,D, Coefficient 



4 83 31,21 7.66 31,80 7,43 ,895 

5 105 35.12 8.57 34.37 8.33 .863 

6 108 35.30 7.75 36.40 3.20 .906 



Face Validity 

The five teachers reviewing the evaluation instrument for grades four 
through six felt that all the items depicted career education concepts. 
The teachers suggested that all items depicted a concept that should be 
given some emphasis in grades four through six, but that some items might 
receive greater emphasis there than others, with some items given greater 
attention in junior and senior high school. 



Content Validity 

The reviewing teachers of the CECQ 4-6 agreed oa the same content area 
in 36 out of the 55 items (see Figure 3). In five cases, one teacher could 
not classify an item into only one of the content areas, but felt that could 
be classified equally well into two or more content areas. Figure 3 shows 
that teachers classified questions in a similar pattern as the test developers. 
The shaded areas are test developers classification and the numbers refer to 
the frequency of inservice teachers classifications. The CECQ 4-6 can be said 
to have content validity since in all cases, teachers identified the content of 
a question as one of the content areas for which the tests were developed and 
teachers classified the content areas of questions similarly to the classifi- 
cations made by the test developers. 
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FIGURE 3 

CONTENT CLASSIFICATIONS OF CECQ 4-6 
AS JUDGED BY TEST DEVELOPERS AND INSERVICK TEACHERS 
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FIGURE 3 (continued) 
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Grade Levels 

The CECQ 4-6 showed mean score increases from 31,2 for fourth grade to 
35.2 for the sixth grade (see Table 11), This is significant at the .01 
level. The correlation between grade level and mean score is also statis- 
tically significant at the .01 level (see Table 12). Tests for significant 
difference between all possible pairs of mean scores (grades 4 and 5, 5 and 6, 
and 4 and 6) did not reveal where the differences were. 



TABLE 11 

DIFFERENCES AMONG MEANS BY GRADE LEVEL 
FOR CECQ 4-6 

± 

Grade Fourth Fifth Sixth F-Ratio Significance 

Mean 31.2 35.1 35.2 5.9 .001** 



**Signif icant at .01 
* Significant at .05 



TABLE 12 

RELATIONSHIP OF STUDENT SCORES TO GRADE LEVEL FOR CECQ 4-6 



Correlation Sign ificanc e 

.219 .001** 



**Signif icant at .01 
* Significant at .05 



Teacher Emphasi s 

During the initial test session, teachers were asked how much time 
(hours per week) during the past year they had devoted to teaching the career 
education concepts, which the Career Education Cognitive Questionnaire was 
designed to measure. The amount of time teachers emphasized the concepts 
was classified into groups of low emphasis and high emphasis. Since there 
were only four teachers at each grade level, a difference between low and high 
emphasis, in some cases, could not be obtained. Grade levels were collapsed 
to obtain one group of low and one group of high emphasis per test. The distri- 
butions of both high and low emphasis groups were carefully reviewed to insure 
that erfch group contained similar numbers of students from each of the three 
grade levels involved in the groupings. The amount of teacher's emphasis on 
Career Education for each of the test levels are as follows: 

low emphasis 0.5 - 2.0 hours per week (N - 126) 
high emphasis 5.0 - 8.5 hours per week (N - 117) 

with the CECQ 4-6 males and females scored equally well at all grade levels 
(see Table 13). 
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TABLE 13 

TEST FOR DIFFERENCES AMONG MEANS BY LOW TEACHER EMPHASIS 
VS. HIGH TEACHER EMPHASIS FOR THE CECQ 4-6 



— - . s 




Emphasis 

Low High t-Value Significance 






34.9 34.4 .57 .566 







**Signif icant at .01 
* Significant at .05 



Sex 

-Another important aspect of an achievement test is its fairness to 
both males and females. Students were grouped according to their sex, and 
mean scores calculated and tested for differences. 

The differences between mean scores for males and females for the CECQ 
4-6 showed not to be significant (see Table 14). 



TABLE 14 

TEST FOR DIFFERENCE AMONG MEANS 
AS AFFECTED BY SEX FOR THE CECQ ^-6 



Grade 


Males 


Females 


t -Value 


Significance 


4 


31.5 


31.4 


.02 


.981 


5 


36.8 


35.2 


1.23 


.222 


6 ■ 


34.8 


35.8 


-.75 


.454 



**Signif icant at .01 
* Significant at .05 



F ather's Occupation ' 

Students were asked to identify the occupations of their fathers. In 
cases where the fathers did not live at home, the students were asked to 
id entify the occupation of the head of the household. The occupation was 
then classified according to the following actegories: 

1 = unskilled 

2 = semi-skilled 

3 = skilled 

4 = semi-professional & small business management 

5 = professional and managerial II 

6 = professional and managerial I 
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Mean test socres were then calculated for each occupational level of the 
father for each grade level and a one-way ANOVA used to compare the means. 

Results of the CECQ 4-6 showed no significant difference among mean 
scores for level of father's occupation at any grade level (see Table 15). 
Table 16 shows a positive correlation at grade six which is significant at 
the .01 level. Relationships at grades four and five did not prove to be 
significant • 



TABLE 15 

DIFFERENCES IN MEAN SCORES AS RELATED TO 
FATHER'S OCCUPATIONAL LEVEL FOR THE CECQ 4-6 



Father's Occupational Level 



.2l£de_ 1 1 3 4 _5 6 F-Ratio Significance 

4 34,7 29.7 32.9 31,3 .442 .724 

5 38.2 37,7 40,1 36.1 39,2 ,9^»3 .447 

6 29.2 26,2 33,4 35,2 40,0 38,2 1.483 .217 



**Signif icant at .01 
* Significant at ,05 



TABLE 16 

RELATIONSHIP OF MEAN SCORE TO FATHER'S 
OCCUPATIONAL LEVEL FOR THE CECQ 4-6 

Grade Correlation Significance 

^ .018 .426 

5 -,009 ,464 

6 ,254 .005** 



**Significant at .01 
* Significant at .05 



Father's Education 

Students were asked to identify their father's highest level of educa- 
tion. In cases where students did not live with their fathers, the educa- 
tion of the head of the household was obtained. Father's education was then 
classified into the following categories: 
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1=1 through 5 years 
2=6 through 8 years 
3=9 through 11 years 

4 = High school graduate (12 years) 

5 = 1 through 3 years of coll€:ge 

6 = College graduate 

7 = College graduate plus additional 

graduate studies 

The mean scores of students were calculated within each level of father's 
education for each grade. 

At grades four through six, there again were no significant differences 
among mean scores for levels of father's education (see Table 17), but 
there was a nearly significant correlation between mean score and father's 
educational level at grade five [.05 level] (see Table 18), 



TABLE 18 



DIFFERENCES IN MEAN SCORES AS AFFECTED BY FATHER'S 
EDUCATIONAL LEVEL FOR THE CECQ 4-6 





Grade 1 


2 


3 




4 


5 


6 




7 


F-Ratlo 


Significance 


4 




29. 


6 


32.3 


32.5 


32. 


9 




.560 


.644 


5 




37. 


5 


36.6 


40.6 


46. 


2 


39.2 


1.380 


.256 


6 


34.2 


28. 


5 


34.7 


38.9 


38. 


2 


38.2 


1.165 


.341 



**Signif icant at ,01 
* Significant at ,05 



TABLE 19 

RELATIONSHIP OF STUDENT SCORES TO FATHER'S 
EDUCATIONAL LEVEL FOR THE CECQ 4-6 



Grade Correlatio n Significance 

,073 
,013* 
.059 



4 ,140 

5 .217 

6 ,151 
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CAREER EDUCATION COGNITIVE QUESTIONNAli^^ 
FOR GRADES 7 THROUGH 9 



Reliabili lies 



The r«iliability coefficients obtained for the CECQ 7^9 r^^^^^ from 
.836 to .916 (see Table 20). Although the reliabilities cjbtai^^^ f^t the 
CECQ 7-9 were the lowest of the three tests, the scores ^^t^ b^ ^'^txgidered 
stable over the two week period. 



TABLE 20 

TEST-RETEST RELIABILITIES FOR CECQ 7-9 



Test Retest 



Grade 


N 


Mean 


S.D. 


Mean 


S.D. 


7 


100 


26.92 


8.70 


27.43 


8.63 


8 


92 


31.31 


10.53 


31.75 


10.34 


9 


90 


32.89 


11.20 


33.41 


10.78 




Face Validity 

The five teachers reviewing the evaluation instrument ^^^de5 seven 
through nine were quite diverse in their comments. Four ^e^o.h^ ^ stated 
that all questions depicted career education concepts, wttl^ ^^^i^^-fth sug- 
gesting that several concepts were not related to career e^^^^^^^^» Assess^ 
ment of the importance of the concepts and teacher emphasi^ va^ greatly. 
Two teachers believed several concepts were not important, .^Q^j^d be 

given some emphasis in the classrooms of grades seven throt^Sh ^ The 
majority of teachers believed that most of the questions d^Plc^^^ ixapottant 
concepts and, therefore, should be given medium to high emp^^s^^ 5,^^ grades 
7-9 classrooms. 



C ontent Validity 

The CECQ 7-9 contains a total of 57 questions. In aiJ- ^Vee cases* 
items were classified into the identified content areas wit^ tt^j ^ajo^^^^ 
of teachers agreeing on one content area (see Figure 4) . ghad^^ ^teaS 
present test developer classifications and the numbers repf^^e^^ ^tecl^^^^y 
of classification by inservice teachers. In three cases^ one <^ . ^He fi^*^ 
teachers could not classify an item since he felt the item ^^^^ M tnor*e 
than one content area. Figure 4 shows that teachers clasc 
content in a pattern similar to that of the test developer^* ^ all of 

the questions depict one or more of the content areas which 
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FIGURE A 

BY TE ^•^SSl^J^t-'-^ilONS OF CECQ' 7-9 
AS jUDGEP Sx ogvKLOPERs ANH I.NSEHVICE TEACHERS 





Tool & Equipment 
jof an Occupation 


w 

V < Qj 

O to K" 

•rH t: 15 
4J ^ 

rj v: 'ta 
G " ) 


1 


1 




2 




1 


3 






4 






5 






6 






7 






8 






9 






10 






11 






12 






13 






lA 






15 






16 






17 






18 






19 






20 






21 






22 






23 






24 


1 




25 


1 




26 








ERIC 



26 



FIGURE ^ (continued) 
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developed to measure, and teacher classif i^^^^^^^ were ^^T^' ^imiU^ those 
made by the test developers, the CECQ 7-9 c^n be ^^^^ nav^ content Validity. 

Grade Levels . . 

The CECQ 7-9 had mean scores ranging f^°!II, ?^,9 fo^ Seventh grade 

to 32.8 for the ninth grade (see Table 21)- is s^^^^^^^dally ^^S^fi- 

cant at the .01 level. The correlation between ^^^^^ jevel j^^an score 

was also significant at the .01 level (see T^^^® ^^j^ Po^t ^^^^ ^^g^s between 
a.; possible mean score pairs (grades 7 and ^ ^^^'g^ and 7 9) di^j ^^^j. 
r^ eal significant differences. 



TABLE 21 

DIFFERENCES AMONG MEAN SCORES BY LEVEl^ ^BiCQ 7^^ 



Grade Sevent h EightTT^^ 
Mean 26.9 31.3 32.8 .001:^^ 



**Signif icant at ,01 
* Significant at ,05 



TABLE 22 

RELATIONSHIP OF STUDENT SCORES TO GRADE j^g^j, FOR C^i^q 7^9 




**Signif icant at .01 
* Significant at ,05 



Teacher Emph asis 

During the initial test session, teache^^^ we^^^ asV-^^ much 
(hours per week) during the past year they ^^^Qted ^^^^hlng Career 
education concepts, which the Career Educati^" ^^^t^itiv^ tonn^^^® ^as 

designed to measure. The amount of time te^i^^^^f ^mph^^^^^^ ^he concept 5 
was classified into groups of low emphasis .§h emp^^^^^* Sin^^ ^^e^^e 

were only four teachers at each grade level > ^ ^"^^^eren^^ ^^^^een 1^^ 
high emphasis in some cases could not be obt^^"^^. Gr^^^ "^^^^Is we^^ ^^llapsed 
to obtain one group of low and one group of ^^^^ ^^phaS^^ test. '^^^ 

distributions of both high and low emphasis g^^JJPs ^^^^ ^^^^^U^y reviewed 
to insure that each group contained similar numbe^^^ gCudeut:^ ^^.^m each 
of the three grade levels involved in the gi^^^P^^S^, Th^ ^"^^U^t of ^^^^her's 
emphasis on Career Education for each of the 3.evel^ foll°^®» 

low emphasis 1.0 - 2.5 hours P^^ V^^k (^^ * 
high emphasis 3.5 - 6.0 hours P^^ V^^k * 



28 



27 



For grades seven through nine the low emphasis group attained a mean 
of 31.6, with the high emphasis group having a mean of 32.1 (see Table 23) 
The difference between the low and high emphasis groups also proved insig- 
nificant. 



TABLE 23 

TEST FOR DIFFERENCES AMONG MEANS BY LOW TEACHER EMPHASIS 
VS. HIGH TEACHER EMPHASIS FOR THE CECQ 7-9 



Emphasis 

L ow High t -Value Significanc e 

31.6 32.1 -.45 .651 



**Signif icant at .01 
* Significant at .05 



Sex 



The results of grades seven through nine showed that there were no 
significant differences between male and female scores (see Table 24). 



TABLE 24 

TEST FOR DIFFERENCE AMONG MEA:;S 
AS AFFECTED BY SEX FOR THE CECQ 7-9 



Grade 


Males 


Females 


t-Value 


Significance 


7 


26.1 


28.3 


-1.30 


.197 


8 


31.7 


34.2 


-1.40 


.164 


9 


33.8 


36.6 


-1.68 


.098 



**Signif icant at .01 
* Significant at .05 



Father 's Occ upation 

Students were asked to identify the occupations of their fathers. 
In cases where the fathers did not live at home, the students were asked 
to identify the occupation of the head of the household. The occupation 
was then classified according to the following categories: 
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1 = unskilled 

2 = semi-skilled 

3 = skilled 

A = semi-professional & small business management 

5 = professional and managerial II 

6 = professional and managerial I 

Mean test scores were then calculated for each occupational level of the 
father for each grade level and a one-way ANOVA used to compare the means. 

At grades 7 through 9 differences in mean scores were significant 
(.01) at grade eight only. Differences at grades seven and nine did not 
prove significant at the .01 level (see Table 25). The correlation between 
mean scores and father's occupation at grades seven through nine were posi- 
tive, but only the relationship at the eighth grade proved significant at 
the .01 level (see Table 26). An attempt to identify significantly different 
pairs of groups at grade eight was unsuccessful. 



TABLE 25 

DIFFERENCES IN MEAN SCORES AS RELATED TO 
FATHER'S OCCUPATIONAL LEVEL FOR THE CECQ 7-9 



Father's Occupational Level 



Grade 


1 




2 




3 




4 




5 


6 


F-Ratio 


Significance 


7 


18. 


7 


28. 


3 


25. 


7 


27. 


5 


28. 


8 


.961 


.432 


8 • 


13. 


3 


26. 


9 


32. 


9 


31. 


7 


27. 


9 38.3 


4.380 


. 001** 


9 


15. 


3 


31. 


6 


37. 


1 


35. 


9 


33. 


3 


3.455 


.012* 



**Signif icant at .01 
* Significant at .05 

TABLE 26 

RELATIONSHIP OF MEAN SCORE TO FATHER'S 
OCCUPATIONAL LEVEL FOR THE CECQ 7-9 



Grade 


Correlation 


Significance 


7 


.092 


.083 


8 


.256 


.001** 


9 


.054 


.229 



**Signif icant at .01 
* Significant at .05 



30 



29 



F ather's Education ■ 

Students were asked to Identify their father's highest level of educa- 
tion. In cases where students did not live with their fathers, the education 
of the head of the household was obtained. Father's education was then 
classified Into the following categories.: 



1 
2 
3 
4 
5 
6 
7 



= 1 through 5 years 

= 6 through 8 years 

=» 9 through 11 years 

= High school graduate (12 years) 

=» 1 through 3 years of college 

=» College graduate 

= College graduate plus additional graduate studies 



The mean scores of students were calculated within each level of father's 
education for each grade. 

At grades seven and nine, differences among meaws for the various levels 
of father s education proved insignificant (see .Table 27). The correlations 
between mean scores and father's educational level proved to be positive 
at grades seven through nine, with grades seven and eight significant at the 
.01 level (see Table 28). 



TABLE 27 



DIFFERENCES IN MEAN SCORES AS AFFECTED BY 
FATHER'S EDUCATIONAL LEVEL FOR THE CECQ 7-9 



Grade 


1 


2 


3 


4 


5 




6 


7 




F-Ratlo 


Significance 


7 


9.3 


25.2 


26.9 


27.2 


32. 


0 


31.3 


29. 


3 


1.692 


.131 


8 


33.3 


31.9 


29.1 


31.6 


28. 


3 


34.9 


41. 


2 


2.940 


.012* 


9 




32.8 


33.6 


36.1 


27. 


7 


31.8 


36. 


9 


1.057 


.390 



**Signif icant at .01 
* Significant at .05 



TABLE 28 

RELATIONSHIP OF STUDENT SCORES TO FATHER'S 
EDUCATIONAL LEVEL FOR THE CECQ 7-9 



Grade 
7 
8 
9 



Correlation 
• 168 
.228 
.107 



Significance 
.006** 
.001** 
.073 



**Signif icant at .01 
* Significant at .05 
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